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SUMMARY 


1.  Overview 

The  Army  Inventory  Research  Office  has  been  involved  in  several  forecasting 
studies  with  the  Intent  of  improving  the  forecast  of  demand  for  replacement 
parts  in  the  Army  wholesale  Inventory  system.  This  report  describes  the 
work  done  with  those  items  which  are  stocked  for  various  reasons  but  ex¬ 
hibit  very  little  demand.  It  was  felt  that  by  studying  the  characteristics 
of  these  items,  a  forecast  algorithm  could  be  developed  which  would  work  better 
than  traditional  methods  when  applied  in  any  inventory  setting. 

The  work  consisted  of  data  experiments  performed  on  a  data  base  of  11  years 
of  quarterly  demands  for  approximately  20,000  aviation  replacement  parts. 

Of  these,  nearly  80%  were  classified  as  Inactive. 


2.  Results 

a.  Descriptive  variables  such  as  maintenance  factors.  Inventory  management 
processing  codes,  unit  price,  and  procurement  lead  time  could  not  be  used  to 
characterize  low  demand  items. 

b.  Many  of  the  inactive  items  had  short  interarrival  times  between  requisi¬ 
tions  leading  to  the  Inference  that  the  requisitions  arrive  in  clusters. 

c.  The  demands  per  requisition  increased  as  the  requisition  frequency  in¬ 
creased  . 

d.  The  data  analysis  did  not  clearly  show  a  dependent  demand  pattern  in 
the  state  series.  The  state  series  ^y^  is  defined  in  the  following  manner: 


y 


t 


1,  xt  >  0 

0,  xt  -  0 


where  is  the  demand  series 

e.  Plots  of  certain  conditional  probabilities  Indicated  that  zeros  tended 
to  follow  zeros  and  ones  tended  to  follow  ones  but  statistical  tests  did  not 
confirm  this. 

f.  Three  expected-value  forecast  algorithms  were  developed  by  making 
various  model  assumptions  based  on  the  data  analysis  results.  The  models  con¬ 
sidered  were:  an  independent  demand  model,  a  first  order  dependence  model  and 
an  inter-arrival  time  model. 
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CHAPTER  I 


INTRODUCTION 

1.1  Overview 

This  report  is  a  compilation  of  experiences  gained  while  trying  to  improve 
forecasts  for  low  demand  items.  It  is  based  on  experimentation  done  on  a 
data  base  of  approximately  20,000  aviation  repair  parts.  This  experimentation 
was  conducted  in  conjunction  with  IRO  Project  263  "Integrated  Forecasting 
Techniques  for  Secondary  Item  Classes"  in  an  effort  to  improve  demand  forecasts 
for  all  items  at  the  wholesale  level.  The  observations  cited  herein  describe 
the  efforts  to  determine  characteristics  of  low  demand  items,  to  develop  appro¬ 
priate  forecast  algorithms  based  on  these  characteristics  and  to  evaluate  these 
algorithms  in  an  inventory  environment .  It  is  hoped  that  these  empirical 
findings  will  prompt  additional  research  in  these  areas. 

1.2  Background 

Over  the  past  few  years,  the  Inventory  Research  Office  (IRO)  has  been  in¬ 
volved  in  several  forecast  projects  designed  to  improve  the  forecast  of  demand 
for  replacement  parts  in  an  automated  wholesale  supply  system  in  operation  at 
the  Army  Commodity  Commands.  In  the  earlier  work  [7]  forecast  algorithms 
were  developed  and  tested  for  use  on  all  items  independent  of  the  demand 
activity  of  the  individual  item.  In  later  work  [10]  items  were  stratified 
into  classes  according  to  requisition  frequency  and  dollar  demand  with  the 
hope  of  finding  optimal  forecast  techniques  for  each  class.  The  work  presented 
here  describes  the  details  of  the  analysis  done  on  the  class  of  low  demand 
or  Inactive  items. 

1.3  Data 

The  demand  history  file  used  in  this  study  consists  of  11  years  of 
requisitions  and  demands  by  quarter  accumulated  from  the  Troop  Support  and 
Aviation  Materiel  Readiness  Command's  (TSARC0M)  Demand,  Return  and  Disposal 
file.  The  items  were  limited  to  aviation  parts  for  which  flying  hours  could 
be  obtained.  The  file  contains  a  sample  of  20,865  items  from  those  which  were 
in  the  system  between  1966  and  1977. 

The  demands  are  limited  to  parts  subject  to  demand  forecasting  in  the  Army 
inventory  management  process.  They  Include  worldwide  recurring  demands  for 
Army  managed  class  IX  secondary  items  (repair  parts  and  spares) .  (Recurring 
demand  is  that  portion  of  total  demand  which  is  representative  of  a  continuing 
demand  process . )  5 


Each  item  is  classified  as  low  dollar  value  (LDV)  or  high  dollar  value  (HDV) 
according  to  whether  the  demand  rate  averaged  over  the  11  years  was  less  than 
or  greater  than  or  equal  to  $50,000.  Items  with  over  a  million  dollars  of 
demand  per  year  were  dropped. 

The  items  were  further  divided  into  dynamic  (D7N)  and  non-dynamic  (NON) 
based  on  the  Federal  Supply  Classification  (FSC).  The  dynamic  components  were 
considered  to  be  those  that  experience  high  rotation  rates;  i.e.  rotor  blades, 
transmissions,  and  turbine  engines.  For  more  detail  see  Cohen  [2]. 

The  data  breaks  out  into  the  following  four  groups  by  number  of  items: 


HDVDYN 

86 

HDVNON 

262 

LDVDYN 

1169 

LDVNON 

19348 

20865 


1.4  Organization 

The  objectives  of  the  study  are  as  follows: 

a.  Identify  an  "inactive  item"  using  only  classification  data  (prior  to 
demand  experience) . 

b.  Determine  statistical  characteristics  of  the  demand  for  these  items. 

c.  Develop  forecast  techniques  which  will  depend  on  the  inherent  nature 
of  this  class  of  items. 

d.  Evaluate  the  forecast  techniques  using  a  statistical  error  measure 
developed  for  this  class  of  items,  and  determine  a  best  forecast  algorithm 
based  on  statistical  and  simulation  results. 

Chapters  II  through  V  cover  the  four  objectives  respectively.  Chapter  VI 
summarizes  the  conclusions  from  each  chapter  and  suggests  areas  for  future 
research. 


CHAPTER  II 


IDENTIFICATION 


2.1  Methodology 

In  the  previous  IRO  studies  the  demand  activity  of  an  item  was  measured 
by  the  average  number  of  requisitions  per  year.  Assuming  that  this  is  a 
reasonable  measure,  each  item's  average  requisition  per  year  was  compared 
with  other  item  variables  in  an  effort  to: 

a.  Identify  properties  of  the  low  demand  items  that  might  be  used  to 
improve  the  demand  forecast . 

b.  Identify  a  low  demand  item  when  little  or  no  demand  history  is 
available . 

2.2  Variable  Description 

The  variables  being  considered  are  separated  into  two  classes ,  demand 
and  descriptive,  and  are  defined  as  follows: 

Demand  Variables 


AVG  REQ  PER  YEAR 
(REQ  Class) 

AVG  DEMANDS  PER  YEAR 
(DMD  Class) 

INTERARRIVAL  TIMES 

Descriptive  Variables 
IMPC  Code 

UNIT  PRICE 
MAINTENANCE  FACTOR 

PROCUREMENT  LEAD  TIME 


The  average  number  of  requisitions  per 
year  observed  during  the  active*  portion 
of  the  series. 

The  average  number  of  demands  per  year 
observed  during  the  active*  portion  of 
the  series. 

The  average  time  between  requisitions 
starting  with  the  first  and  ending  with 
the  last. 


Inventory  Management  Processing  Code,  a 
code  designed  to  Indicate  the  status  and 
supply  policy  for  the  item. 

The  price  charged  to  the  customer  for  the 
item. 

An  engineer  estimate  of  the  expected 
number  of  failures  for  a  given  part  per 
100  end  items  in  one  year. 

An  estimate  of  the  time  it  takes  to  receive 
1/3  of  the  order  once  the  buy  decision  is 
made. 


Double  12  month  moving  average  starting  after  the  first  non-zero  demand. 

7 


2.3  Observations 


The  following  inferences  may  be  drawn  from  the  tables  at  the  end  of  this 
chapter  where  the  lower  requisition  classes  (up  to  6  req.  per  year)  are  cross 
tabulated  against  each  of  the  other  variable  classes. 

Requisition  vs  Demand:  As  the  requisition  frequency  increased  so  did  the 
requisition  size,  i.e.,  in  class  [0,1),  60%  of  the  items  had  one  demand  per 
requisition,  whereas  in  req  class  [5,6)  only  5%  averaged  this  low.  Consequently 
the  demand  per  requisition  ratio  is  requisition  class  dependent  and  unit 
requisition  size  cannot  be  assumed. 

Requisition  vs  Interarrival  Time:  Low  average  interarrival  times  (1,2,3) 
dominated  all  requisition  classes  including  the  lowest  demand  classes.  This  in¬ 
dicates  a  possible  clustering  effect,  i.e.  several  back  to  back  requisitions 
during  the  active  portion  of  the  series  (e.g.  (0 ,0 ,0, 1 , 1 , 1 ,0 ,0 ,0)  =  1  quarter 
interarrival  time) . 

Requisition  vs  IMPC  Codes:  82%  of  all  items  had  an  average  requisition 
frequency  of  less  than  6  per  year  and  of  these  - 
25%  were  stocked 
21%  were  non-stocked 
20%  were  semi-active 
13%  were  insurance  items 
9%  were  terminal 

Also  15.5%  of  all  items  were  stocked  and  had  average  requisitions  less  than 
3  per  year. 

Requisition  vs  Unit  Price:  Unit  price  was  distributed  approximately  the 
same  throughout  each  requisition  class. 

Requisition  vs  Maintenance  Factor:  Low  Maintenance  Factors  dominated  all 
the  requisition  classes. 

2 . 4  Conclusion 

For  low  requisition  class  items,  the  demands  may  occur  in  clusters  and 
the  number  of  demands  per  requisition  is  related  to  requisition  frequency.  None 
of  the  descriptive  variables  can  adequately  predict  the  requisition  activity 
of  the  item. 
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CHAPTER  III 


PROBABILITY  CHARACTERISTICS  OF  DEMAND 


3.1  Introduction 

In  this  chapter  the  question  of  dependency  between  the  zero  and  non-zero 
demand  states  of  the  series  is  explored.  It  was  alluded  to  in  the  previous 
chapter  by  observing  the  short  inter arrival  times  for  low  demand  items  that 
the  non-zero  demands  may  occur  In  clusters.  If  this  is  true,  then  the  probability 
of  getting  a  non-zero  demand  In  the  future  is  dependent  on  the  observed  history 
of  the  series. 

3.2  Leading  and  Trailing  Zeros 

One  of  the  problems  In  analyzing  the  data  was  the  fact  that  many  of  the 

individual  items  had  clusters  of  leading  or  trailing  zeros.  In  the  real  world 

these  series  may  represent  the  phasing  in  or  out  of  the  item  and  would  not  be 

characteristic  of  the  actual  demand  for  the  item. 

These  potential  exogeneous  observations  had  no  Impact  on  the  demand 
* 

variables  in  the  previous  chapter  but  were  considered  in  the  analysis 
presented  in  this  chapter. 

3.3  The  State  Series  and  its  Order  18 


Throughout  the  analysis  in  this  chapter,  we  employ  the  state  series  concept 
to  determine  the  probability  of  demand.  This  concept  is  as  follows: 


Let  \xt\  he  the  quarterly  demand  series. 

Define  ^  y^  as  the  state  series  such  that 

r  1  if  xt>  0 

\  -) 

^0  if  xt-  0 


Define  the  order  of  ^y^  ,  (the  order  of  a  Markov  chain) ,  as  the 
smallest  k  such  that  y£  is  independent  of  observations  prior  to  yt_^  for  all  t. 

* These  variables  were  measured  between  the  first  and  last  demands. 


I 


(i.e.  Probability  ^yjy^,  yt_2.---}“  P  { yt  lyt-l’yt-2 . yt-kj) 

Hence  if  k  -  0,  then 

P(y  “1)  or  P(yt=0)  is  independent  of  the  past 
and  if  k  <=  1,  then 

p  lyt  lyt-l  =  °S  *  p  iyt  iyt-l  =  and  yt  is  dependent  on  the  last 

quarter  of  data  only.  Similarly  for  all  k  >  0,  the  states  of  y  are  dependent 
on  the  past  k  observations. 

3.4  Determining  the  Order  of  the  State  Series 

Sweet  in  referenced  article  [8]  describes  the  use  of  Akaike's  information 
criterion  in  determining  the  order  of  the  state  series.  In  the  same  article  he 
includes  a  program  which  not  only  determines  the  order  of  the  series  but  also 
estimates  the  transition  probabilities.  This  program  was  modified  so  that 
several  series  could  be  evaluated  concurrently  and  a  distribution  of  the  orders 
generated.  It  was  hoped  that  one  order  would  dominate  the  results. 

When  testing  the  above  program,  it  was  found  that  this  technique  favored 
lower  orders  when  the  length  of  the  series  was  relatively  small.  Several 
specific  Markov  series  of  length  44  (length  of  our  observations)  were  tested; 
the  slightest  deviation  from  the  exact  series  caused  the  identification  of  a 
lower  order  and  in  most  cases  the  order  was  zero. 

When  testing  the  actual  series,  with  and  without  the  leading/trailing  zeros, 
it  came  as  no  surprise  that  95 7.  of  the  series  resulted  in  zero  order. 

3 . 5  Wald-Wolfowitz  Runs  Test 

Another  method  of  testing  for  independence  between  the  Os  and  19  in  the  state 
series  is  the  Wald-Wolfowitz  runs  test .  This  is  a  two  tailed  test  for  randomness 
using  the  statistic  K,  the  number  of  runs  in  the  series.  Independence  is  re¬ 
jected  for  both  large  K  (too  many  runs)  and  small  K  (too  few  runs) . 

It  was  observed  that  state  series  with  order  0  had  Is  evenly  dis¬ 
tributed  (not  clustered)  leading  to  a  large  K  or  rejection  of  the  runs  test.  On 
the  other  hand,  large  K  did  not  necessarily  Imply  a  non-zero  order  of  the  state 
series.  Hence,  even  as  a  one  tailed  test  (large  K)  the  runs  test  is  less  con¬ 
servative  in  rejecting  randomness  than  is  the  Akaike  information  approach. 

18 


. .  1 

:  i 

Considering  the  other  tail  of  the  test ,  few  runs  indicate  that  the  Os  and 

:  ! 

Is  cluster.  This  clustering  would  not  be  identified  in  short  series  by  using  I 

the  Akalke  criterion.  | 

The  Wald-Wolfowltz  runs  test  was  applied  to  the  various  sets  of  data  with  an 
alpha  level  of  .05  for  a  two  tailed  test.  Consistent  with  the  Akaike  informa¬ 
tion  finding,  randomness  was  not  rejected  because  of  a  large  K  statistic,  but 
on  the  other  hand,  there  were  many  cases  where  K  was  sufficiently  small  for  J" 

rejection,  indicating  possible  clustering.  The  results  of  this  test  are  found 

in  Table  1  for  the  low  dollar  value  dynamic  and  non-dynamic  sets  of  data.  [ 

I 

3.6  Heuristic  Approach  j 

I  ■ 

In  a  final  effort  to  determine  if  dependency  is  evident  in  the  state  series, 
empirical  observations  were  made  on  each  requisition  class  of  items.  Frequency 
estimates  were  made  for  each  transition  probability  for  four  Markov  orders 
(state  series  orders),  0  thru  3,  using  all  the  series  within  the  requisition 
class. 

Example:  Assume  order  1,  then  the  transition  probabilities  in 

question  would  be  < 

P<0|1)  ! 

P(0|0) 

P(l|l) 

P(l|0) 

and  the  point  estimate  for  P(0jl)  would  be 

V 1  '  NT(1,0)  +  NT (1,1) 

where  NT(1,0)  ■  number  of  times  a  1  was  followed  by  a  zero  in  all  the 
series  within  the  requisition  class.  Similarly  NT(1,1)  ■  number  of  times  a  1 
was  followed  by  a  1. 

Also  P(l|l)  -  1  -  P(0|l)  » 
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Now  if  the  observations  of  each  series  were  indeed  independent,  then  the 
transition  probabilities  of  going  to  a  given  state  would  be  the  same  for  all 
assumed  Markov  orders.  Since  clustering  appears  to  be  evident,  a  heuristic 
to  determine  if  the  cluster  effect  is  sufficient  to  reject  the  hypothesis  of 
independence  is  to  test : 

P(0)  -  P(0 | 0)  =  P(0|0,0)  -  P(0l0,0,0) 
and  P(l)  -  P(l|l)  -  P(l|l,l)  -  P(l|l,l,l) 

Graphs  of  the  point  estimates  for  each  of  the  above  probabilities  and  for  each 
requisition  class  are  given  at  the  end  of  the  chapter  (1160  items) .  The  analysis 
was  done  with  and  without  the  exongeneous  observation  (leading  and  trailing  zeros 
The  most  noteworthy  observations  from  these  graphs  are  as  follows: 

1.  P(0)  <  P(0[0)  <  P(0|0,0)  <  P(0|0,0,0) 

P(l)  <  P(l|l)  <  P(l|l,l)  <  P(l|l,l,l) 
for  all  requisition  classes. 

2.  The  most  significant  difference  in  the  above  probabilities  in 
all  cases  are  - 

P(0|0)  P(0)  (fir8t  order  Markov  property) 

and  P(l|l)  -  P(l) 

3.  The  probabilities  are  requisition  class  dependent  especially  at 
the  lower  state  orders. 

4.  Omitting  the  trailing  and  leading  zeros  had  significant  impact 
on  the  estimated  probabilities. 

3.7  Conclusions 

The  data  analysis  presented  in  this  chapter  did  not  clearly  show  any 
dependent  demand  pattern  in  the  state  series.  There  was  an  indication  of 
clustering  where  zeros  tended  to  follow  zeros  and  similarly  ones  tended  to 
follow  ones.  Plots  of  certain  conditional  probabilities  indicate  that  this 
clustering  may  be  best  represented  by  a  first  order  Markov  property  even  though 
statistical  tests  did  not  confirm  this.  It  was  also  evident  from  these  plots 


I 

that  the  probability  of  demand  was  dependent  on  the  requisition  class  and  the 
use  of  catalog  estimates  may  be  useful. 

In  the  next  chapter,  these  observations  will  be  considered  assumptions 
for  various  models,  and  based  on  these  assumptions,  specific  forecast  algorithms 
will  be  developed. 
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CHAPTER  IV 


FORECAST  ALGORITHM  DEVELOPMENT 

4.1  Background 

For  low  demand  or  Inactive  items,  both  Croston  [5]  and  Sweet  [8]  recom¬ 
mended  making  separate  estimates  of  demand  size  and  the  probability  of  getting 
a  demand.  Croston  pointed  out  that  in  an  inventory  environment,  traditional 
forecast  techniques  such  as  exponential  smoothing  on  the  demand  series  often 
resulted  in  excess  stock.  Sweet  demonstrated,  using  weekly  demands  for  rolled 
steel,  that  this  decomposition  approach  was  superior  to  traditional  methods. 

These  techniques  differed  only  in  their  way  of  estimating  the  probability 
of  getting  a  future  demand.  Croston  modelled  the  interarrival  times  of  demand 
and  developed  an  appropriate  estimate  whereas  Sweet  modelled  the  Markov  pro¬ 
perties  of  the  state  series  and  estimated  the  transition  probabilities  once 
the  order  of  the  state  series  was  established.  Both  methods  relied  on  tradi¬ 
tional  techniques  to  forecast  the  conditional  size  of  demand  given  a  demand 
occurred. 

In  the  sections  that  follow,  both  Croston's  and  Sweet's  methods  are  used 
to  develop  expected  value  forecast  algorithms  based  on  model  assumptions  that 
appear  appropriate  from  the  empirical  observations  cited  in  the  previous  chapter. 
These  techniques  are  adapted  to  inventory  models  where  a  forecast  for  the 
total  demand  over  an  item's  procurement  lead  time  (PLT)  is  needed.  This  PLT 
is  variable  between  items. 


4.2  Notation 

Let  ^  x^  be  the  quarterly  demand  series  of  a  given  item,  t 
and  let 


PLT  be  the  item's  procurement  lead  time  in  quarters 
Then  define  the  following  series: 


State  Series 

1  ^tl  such  that  yt 


1  if  x  >  0 
0  if  x  -  0 


1,2,3, ., 


Lead  Time  State  Series 

PLT 

\Zt\  ,*ere*t-  jZ=1yt+j 


2t  -  0,1,2, ...PLT 


Non-Zero  Demand  Series 


^d^  where  d^  =  non-zero  demand  in  series 


Note:  At  time  t,  let 

N (t)  -  max  ^j|dj  occurred  by  time  t^ 


then 


Vt)  -  last  non-zero  demand  observed  by  time  t 
Vo  +<*  ■  non-zero  demand  occurring  after  time  t 


Interarrival  Time  Series 


ill  where  I  ■  time  in  quarters  between  d  and  d 
^  ^  of  the  original  series  ^  ^ 

Note:  At  time  t 

IN(t)  -  last  interarrival  time  observed  by  time  t 
rN(t)+J  *■  interarrival  time  after  time  t 

Composite  Series 

W  ■  t  -  0,1,2.,. 

4.3  Independent  Model 
Assumptions 

a.  \ytl  a  8etJuence  Bernoulli  trials 
where  P(y£  -  1)  ■  p  and 

P(yt  -0)«l-p«q 
for  every  t 
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b. 


traditional  estimate 


^  is  independent  of  ^y^  and  d 


i+t 


of  having  observed 

^1*  ^2* * ' ‘ ,dj 


Forecast  Development 

Now  by  using  the  ^z^  series  (the  number  of  non-zero  demands  during  a 
PLT  period  after  time  t)  and  the  fact  that^y^  is  independent  of  j^d^  »  we  have 
the  expected  demand  for  a  given  ^d^  series  after  time  t  for  a  PLT  period  is: 

PLT  ,  PLT  i 

E 1  ^  *4  ■  I?h«  ■  °  i 


PT  T  i 

-sr>  f  .PLT*  i  PLT-i 

WN(t)+t)J 


where 

P(zt“i)  -  binomial  probability  of  exactly  i  non-zero  demands 
in  PLT  periods 

and  if  the  non-zero  demand  series  is  stationary 

i-e«  (d^^^)  •  (d  +  (random  noise))  for  every  PLT 

PLT  PLT 

then  E|e  Vm  -  E  P(z-i)(i)(d) 

Li-1  c  i-1  c 


-  (PLT)  (p)  (d) 

Now  the  PLT  forecast  at  time  t  is 


PLT 

I 

i-1 


A 

t+i 


PLT-i 


or  if  jd^ 


is  a  stationary  series 


PLT.  .  . 

[.jVi  ’  Sum 

where  $  is  an  estimate  from  y^  y2 . .  or  a  catalog  of  similar  series 

(e.g.  based  on  requisition  classes) 

and  is  an  estimate  from  c^,  dj,...,^^ 
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4.4  First  Order  Dependence  Model 


Assumptions 

a'  ^yt\  is  a  firat  order  Markov  process,  i.e.  p(ytlyt_^»  yt-2 ’ ‘ ' ,yt-k^  “ 
pCyt | yc_i>  for  every  t  and  k,  0  <  k  <  t 

define  P(yt  =  J | y t_1  “  i)  =  for  i  and  j  either  0  or  1 


b.  Same  as  b  from  Independent  Model 
Forecast  Algorithm  Development 

The  expected  lead  time  demand  is,  as  before. 


PLT  -1 

PLT 

Vl' 

“  P  [ 
i“l 1 

-P(V«  <W«>] 

But  now  P(zt  *»  i)  is  more  complex  due  to  the  first  order  dependency  of 
the  ^y^  series.  To  compute  P(zt  =  i)  consider  the  following  argument: 

Let<^_-  £<yt+1.  yt+2.---.yt+PLT)|  yt+k  -  0,1} 


series . 


be  the  set  of  all  possible  future  events  or  outcomes  of  the  state 

,  PLT  ’ 
i 


Then  there  exist  exactly 


0-5 


PLT! 

!  (PLT-i) ! 


events  that  satisfy  -  i  (the  number  of  ways  of  arranging  i  ones  and  PLT-i 
zeros) . 


Now  let 


v1- 


^  ■  [Eil*  Ei2 ’  Ei3’-”Ei  CP^T)] 


be  the  subset  of  events  satisfying 


Then  P(z  **1)  -  Z  P  (E  |  y  )  (Markov  Property) 

j-1  1J  c 

where  p (^i j I y t >  *8  co®Puted  u8inB  the  transition  probabilities  as  illustrated 
by  the  example  at  the  end  of  this  section. 
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PLT  .  PLT  (PiT)  i  -i 

tUXt+i]  "  1-1 L  U  ‘WiU 


Now  E 


and  the  PLT  forecast  at  time  t  is 

w 


PLT  A  PLT  \  i  '  i  , 

l-lI‘t+1'Utj-lP<Ell|yt)^l  Vo+tJ 

or  if  is  a  stationary  series 

PLT  „  PLT  W). 

\ml  Xt+i“  Vo+l  [ml  1  £.  P(Eij!yt) 


where  P(E44|y^)  is  computed  using  Pqq.  ^qi*  Pll*  P10  are  estimates 


ij  t 


from  y^,  y2,...,yt  or  from  a  catalog  of  similar  series  and  is  estimated 

from  d^,  d2> . . . as  in  the  independent  model. 

At 

Example:  Suppose  PLT  -  4,  i  ■  2.  Then  there  exist  exactly  events 

satisfying  the  condition  «  i  =  2,  one  of  these  being  E21  =  (0,0, 1,1) 

where  P(E21J  yt  -  0)  -  pQQ  .  ?QQ  ,  pQ1  •  Pn 

and  P(E2jyt  -  1)  -  p1Q  -  P0(J  •  PQ1  •  Pn 


4.5  Interarrival  Time  Model 
Assumptions 

a.  ^Ij^is  a  sequence  of  independent  exponentially  distributed  random 
variables  such  that 

P(Ij  ■  t)  -  X  1  exp  (  -  t/x),  0  <  t  <  * 

b.  Same  as  b  from  independent  model. 

Forecast  Algorithm  Development 

The  expected  lead  time  demand  is,  again: 
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Now  P(zt  ■  i)  is  the  probability  of  getting  i  demand  arrivals  in  a  PLT  (time), 
and  is  a  Poisson  process  with 

P(zt  *  i)  -  ^~-X!L-T  ^•^)1  i  *»  0, !,  2, . . . 


and 

r  PLT 
£1 

1  i=l 

Xt+i  ]  " 

PLT 

Z 

i«l 

the  PLT 

forecast  at 

time  t  is 

PLT  A 

V  -V 

PLT 

-  H 

1*1 

e~x*r 

S  Xt+i 

i=l  Z 

(C"X'PLT) (X-PLT)1 


^  dNCt)H-fi.  ) 


C;vPLT) 


1 


or  if  is  a  stationary  series 

PLT  a  .  PLT  : 

Z  x  =  L  .  .  Z  ±-*~  X’PLT( 

i-!  t+1  ^(t)+1  i-1  Ti 


X-PLT) 


“(dN(t)+l^  *  PLT)“  E  e  ~X,PLT(X«PLT)1>  j 
K  J  i-PLT+1  i! 


**11(0+1  X  ’PLT 


where  —  is  an  estimate  of  the  mean  of  the  interarrival  series  I„ ,  I. . 

or  the  mean  of  the  interarrival  times  from  a  catalog  of  similar  series  and 

VtH*  18  estimated  from  di*  d2*  * '  *  ,dN(t) 

The  following  are  comments  on  the  assumptions: 

a.  1^  is  an  integer  variable  where  the  interarrival  time  is  measured 

in  quarters  (not  continuous  as  model  assumes) . 

b.  Zfc  is  truncated  in  that  Z^.  -  0 ,1,2 , . .  .PLT . 

The  implications  of  these  contradictions  to  the  model  have  not  been  fully  identified 
but  it  appears  that  the  forecast  algorithm  may  be  reasonable  based  on  experience 
cited  by  Croston  and  the  fact  that  the  resulting  algorithm  is  not  that  different 


from  the  Independent  Model. 

4.6  Conclusions 

The  three  forecast  algorithms  developed  in  this  chapter  were  derived  so 
that  they  would  be  unbiased  estimates  of  the  mean  of  future  demand  over  a  PLT 
for  each  specific  model.  In  no  case  was  consideration  given  to  minimizing 
any  error  criterion  such  as  mean  squared  error.  In  the  next  chapter,  the 
problems  with  evaluation  in  an  inventory  environment  will  be  considered,  par¬ 
ticularly  for  the  low  demand  series  considered  in  this  report. 
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CHAPTER  V 


EVALUATION 

5 . 1  Background 

There  is  no  clearly  defined  methodology  for  evaluating  forecast  algorithms 
in  an  inventory  management  system.  In  the  past,  ref  [11  ],  statistical  error 
measures  such  as  mean  squared  error  (MSE) ,  mean  absolute  deviation  (MAD)  and 
functions  thereof  have  yielded  inconsistent  rankings  among  themselves  and 
with  the  current  IRO  supply  simulator.  Also  findings  from  [6]  and  the  table 
in  the  Appendix  illustrate  that  for  series  with  many  zero  observations  the 
traditional  statistical  error  measures  favor  algorithms  yielding  routinely 
small  forecasts  and  in  fact  will  probably  most  favor  the  degenerate  algorithm 
which  forecasts  zero  all  the  time.  This,  of  course,  is  not  necessarily  an 
optimal  policy  for  a  supply  system. 

As  an  alternative,  it  may  be  proper  in  a  philosophical  sense  to  investigate 
forecast  algorithms  as  they  interrelate  with  a  suitable  supply  management  policy 
for  inactive  items.  Since  we  have  plans  to  analyze  modified  supply  policies, 
the  rankings  of  algorithms  under  a  simulator  of  current  policy  are  moot.  For 
example  a  reasonable  policy  may  be  to  order  wnen  the  probability  of  a  demand 
next  period  is  highest,  in  which  case  an  algorithm  which  accurately  projects 
probabilities  of  any  demand  in  near  term  would  be  valuable. 

For  these  reasons  a  statistical  surrogate  of  a  simulator's  cost-performance 
measure  was  utilized  in  the  current  analysis  of  inactive  items.  Details  of  the 
development  and  experience  with  this  evaluation  method  can  be  found  in  [11] . 

5.2  Methodology 

Overview 

The  impact  of  an  overforecast  error  in  predicting  demand  is  different 
from  that  of  an  underforecast.  Overforecasts  result  in  carrying  too  much 
stock  which  imposes  a  higher  cost  to  the  system  whereas  underforecasts  result 
in  requisitions  not  being  satisfied  and  a  degradation  in  performance.  It  is 
this  tradeoff  between  these  two  types  of  errors  which  is  the  impetus  behind 
the  evaluation  methodology  described  in  this  section. 

This  cost-vs-performance  relationship  is  attained  by  computing 
two  error  measures  for  each  item  and  rolling  the  measures  up  over  the  items. 

The  cost  measure  computed  each  time  an  overforecast  is  made  is  an  estimate 
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of  the  percent  of  total  dollar  demand  which  is  spent  on  extra  stock. 
Similarly  the  performance  measure  computed  each  time  an  underforecast  is 
made  is  an  estimate  of  the  total  number  of  requisitions  not  satisfied. 
(Refer  to  the  section  on  error  measures  for  details.) 

For  each  forecast  algorithm  tested,  various  performance  levels  are 
computed  by  adjusting  the  forecast  (adding  or  subtracting  a  percent  of  the 
forecast)  to  represent  the  impact  of  adding  a  safety  level  (negative  or 
positive) .  With  each  level  of  performance  a  corresponding  cost  is  computed 
yielding  a  cost  vs  performance  curve  for  each  forecast  method. 


C 

o 

s> 

T 


O'*  »*'  Ah  C  C 


"Pcrf 

Curves  closest  to  the  x-y  axis  represent  better  performance  or  lower  cost. 

Error  Measures 
Notation 

For  the  given  ith  demand  series  and  its  corresponding  ^ 

requisition  series  (the  number  of  requisitions  in  period  j) 

Let  D.  .(*)  -  £!x,  .  be  the  demands  over  periods  from  time  t 

*■  f  t  j  — 2 

A  r 

Vj  ^Cv)  *  one  of  the  lead  time  forecasts  from  Chapter  IV. 

*•  9  t 

Q. 

R,  ..(<0  “  Zj  r<  ,..1.4  he  the  number  of  requisitions  over  periods 
i,t  j.j,  i.t+j  from  tlme  t 

JL 


EL 


AD  -  &  AD  -  D.  AD)  -  L  (x,  t.,)  be  the 

■  i,t  i,t  j.j_  i.t+j 

over  lead  time  5k  made  at  time  t 


errors 
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UP^  «  unit  price  of  the  iC^  item 

F  *  index  set  of  forecasts  for  i^  item,  i.e.  those  times 
at  which  forecasts  are  needed. 


Cost  (Overforecost)  Measure 


OF(i) 


(8) 


UP 


i 


*  max  \  EL  (8),ol  UP. 

jtFi  L  i.3  -i 


OF  - 


(8) 


is  a  percent  of  the  total  dollar  demand  spent  on  extra  stock.  The  base  period 
8  is  used  to  capture  the  long  term  effect  of  an  overforecaBt . 


Performance  (Underforecast)  Measure 


UF(i) 


EL  (PLT) 

— ±J - »  o 

(PLT) 


j (PLT) 


is  an  estimate  of  the  number  of  requisitions  not  satisfied  for  the  ith  item, 
i.e.  if  demand  is  underforecasted,  say  by  20%,  then  it  is  implied  that  20%  of 
the  requisitions  will  not  be  satisfied. 


N 

57  U*(i) 

UF  -  i=i 


N 


5T  Z_(Rij<PLT)} 


i-l  JtF 


is  an  estimate  of  the  percent  of  the  total  requisitions  not  satisfied  over  all 
the  items. 

The  base  period  is  shortened  to  the  procurement  lead  time,  which 
represents  the  quickest  time  stock  could  be  replenished  after  a  new  order  is 
placed.  In  an  underforecast  situation  the  reorder  point  will  probably  be  crossed 
within  a  PLT. 
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Data  Collection  Procedures 


The  following  describes  the  method  for  collecting  the  statistical 
data  from  the  actual  series : 

(1)  Each  series  starts  with  the  first  non-zero  demand,  (leading 
zeros  are  omitted) 

(2)  Forecasts  are  made  only  after  the  8th  quarter. 

(3)  Forecasts  are  made  only  in  a  quarter  in  which  a  demand  has  occurred. 

(4)  The  statistics  are  collected  after  the  13th  quarter. 

(5)  The  forecasts  are  rounded  to  the  next  highest  integer. 

(6)  Forecasts  are  made  up  to  PLT  periods  before  the  end  of  the  series. 

(7)  Each  item's  PLT  is  used  when  computing  the  underforecast  measure. 


5.3  Algorithm  Implementation 

Assuming  that  the  non-zero  demand  series  £  d^  is  stationary  (no  trends) , 
the  forecast  from  each  algorithm  developed  in  Chapter  IV  may  be  expressed  as 
an  estimate  of  the  mean  number  of  non-zero  demand  quarters  in  the  next  PLT 
quarters  times  an  estimate  of  the  mean  demand  in  a  quarter  given  that  there  is 
a  demand ,  i . e . , 


PLT 


/s 


/V  A 


z;  Vj  ■  ek>  •  si-whi’  ■  Elv d 

The  Y  series  (non  zero  demands)  is  assumed  independent  of  the  ^  series 

for  each  model  and  consequently  its  mean  is  estimated  the  same  for  each  algo¬ 
rithm  via  a  single  average  of  all  previous  observations  of  the  ^d^  series,  i.e. 

A  A  N(t) 

d  "  VtHl  ”  ^  di/N(t) 


It  was  felt  that  since  the  actual  series  were  so  short  (28  periods)  and  the 
resulting  series  £d^  would  be  even  shorter,  there  would  be  little  to  gain  in 
using  other  procedures  such  as  exponential  smoothing  to  estimate  d. 

The  expected  number  of  non-zero  demand  quarters  in  the  next  PLT  quarter 
is  model  dependent  and  is  computed  by  using  a  catalog  of  estimated  model 
parameters.  These  catalogs  are  broken  out  by  the  requisition  class  of  the  series, 
and/or  the  length  of  the  PLT.  The  estimated  parameters  were  computed  using 
the  total  data  base,  which  was  stratified  by  requisition  class. 


The  basic  steps  in  computing  the  forecast  for  each  algorithm  is  as  follows: 

Step  1:  Identify  the  requisition  class  of  the  series  (compute  the  average 
number  of  requisitions  per  year  for  the  previous  two  years  -  this 
allows  the  series  to  migrate  between  classes  over  time). 

Step  2:  Using  the  item's  PLT,  the  results  from  Step  1,  and  the  model's 

catalog  estimate  the  expected  number  of  non-zero  demand  quarters 
(E(Zt))  in  the  next  PLT  quarters.  (Refer  to  the  next  3  paragraphs.) 

Step  3:  Compute  the  average  number  of  demands  of  the  non-zero  demand 
quarters  from  the  item's  previous  history. 

Step  4:  Multiply  the  results  from  Step  2  and  Step  3. 

The  catalogs  as  computed  for  each  model  are  as  follows: 

Independent  Model 

For  the  Independent  model  it  was  shown  that  z  has  a  binomial  dis¬ 
tribution  with  parameter  p  (Probability  of  a  non-zero  demand  quarter)  and 


E[zt]  *  PLT  x  p 


zt  =  0,1,2, ...,PLT 


The  catalog  for  this  model  contains  the  estimate  of  p  for  each  requisition 
class.  These  are  as  follows: 


Independent  Model 


Class  j  [0,. 32  ]1(32,. 66]|(.66tl]|(l,1.33]j(l. 33,1. 6]  (1.6,2]|(2, 3]  (3, 4]  (4,51(5, 61(6,71(7,8]  I 

.AO  . A1  |  .46  .57  .62  .7  |  .74  t  .89  i 


Dependent  Model 


For  the  dependent  model  the  expected  value  of  zfc  depends  on 
transition  probabilities  pQ^  and  in  the  following  manner. 

(PLT) 

PLT  V.  <  / 

E[z  ]  “  /Eh  C  i)  (refer  to  page  33) 

T-l  j-1  3 


where  p(E^)  y^)  can  be  computed  directly  from  and  P-q*  Hence  the  only 
parameters  that  need  be  estimated  are  p^^and  p^,  Also  Etz^]  depends  on  the 
PLT  through  a  series  of  iterations  over  (r A)  events  which  does  not  have  a 
simplified  expression.  A  catalog  was  generated  using  the  estimates  of  p^  and 
p^  for  each  requisition  class  and  yielding  E[zt|PLT  and  Req  Class].  The 
catalog  is  shown  on  page  41. 


Interarrival  Time  Model 


For  the  interarrival  time  model^z^is  assumed  to  have  a  Poisson 
distribution  with 

E(zt)  -  ^'PLT  st  -  0,1,2,... 

The  only  estimate  in  this  case  is  ^  or  ^  which  is  estimated  from  the 
interarrival  time  series  ^1^  of  similar  requisition  classes.  The  resulting 
catalog  is  as  follows: 


Interarrival  Time  Model 


REQ 

(0, .5] 

(.5,11 

(1,1.5] 

Cl. 5.21(2,2.5] 

1(2.5,31 

(3.3.51 

(3.5,4] 

(4,4.5] 

(4.5,5](5,6] 

>s 

> 

11 

5.06 

3.2 

.  J.-7  .1  2.3 

1.9 

_ A.?  8 _ 

1.4 

1.3 

1.2  1.1 

5.4  Results 

Experimental  Design:  Two  samples  were  used  for  the  evaluation.  The  first 
and  smallest  sample  consisted  of  230  inactive  items  and  was  used  to  determine 
the  best  method  from  each  of  the  following  two  groups. 

Decomposition  Group 

IND  ■  Independent  Model  -  Page  30 

DEP  ■  Dependent  Model  -  Page  32 

INT  *  Interarrival  Time  Model  -  Page  33 

Control  Group 

1794  (Method  currently  used)  *  eight-quarter  sum  of  the  demands 
divided  by  eight  quarter  sum  of  the  flying  hours. 

MOVD  *  eight  quarter  moving  average  on  demands  only. 

The  second  sample  consisted  of  9228  items  and  was  used  for  the  final  eval¬ 
uation.  This  sample  was  stratified  into  nine  classes  based  on  yearly  dollar 
demand  and  requisitions  per  year.  The  following  table  lists  the  item  count  and  total 
dollar  demand  for  each  cell.  Classes  1,2,4,  and  5  were  used  for  the  analysis. 


) 
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ITEM  COUNT  AND  YEARLY  DOLLAR  DEMAND 


YEARLY  $ 
DEMAND 

YEARLY 
if  OF  REQ 


0-3 


12 


I 


>  12 


i 


i 

i 

i 

i 


0  -  $5000 _ 

Class  1  _ 
if  Items  -  5795 
Total  $  DEMAND  - 
$3,872,620 


Class  A 
#  =  1943 
$  -  14,690,818 


Class  7 
#  -  789 

$  -  18,803,075 


$5000  ~  $50000 

Class  2 
if  *=  98 

$  =  4,154,851 


Class  5 
if  «  231 
$  «  33,001,728 


Class  8 
if  «  363 

$  -  82,521,146 


i 

I 

l 

i 

i 

i 

I 

i 

i 


j 

|  $50000 

Class  3 
No  Sample 


Class  6 
No  Sample 


r  ■ 

Class  9 


(  if  *  6 

'  $5,843,061 

i 

t 

I 
» 

i 

» 
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A  separate  Cost  vs  Performance  curve  was  computed  for  each  algorithm 
by  adjusting  the  forecast  by  each  of  four  multiplitive  factors  (.5, 1,1. 6, 2) . 

The  resulting  curves  were  analyzed  by  comparing  performance  for  a  fixed 
standard  cost.  (1794  cost  at  15%  of  requisitions  not  satisfied  representing 
cost  currently  being  incurred  at  current  performance) 

Inferences  from  the  Graphs  (Refer  to  pages  45  thru  49)  are  as  follows : 
(Performance  is  in  terms  of  requisitions  not  satisfied  by  the  end  of  a  lead  time) 

(1)  Graph  1  (Small  Sample) 

(a)  Dependent  Model  satisfied  an  additional  5.5%  of  total 
requisitions  over  1794  for  the  same  fixed  cost. 

(b)  Interarrival  Time  Model  performed  poorly  compared  to  the  other 
decomposition  models. 

(c)  1794  and  the  Dependent  model  were  chosen  for  the  final 

evaluations . 

(2)  Graph  2  (Strat  Class  1) 

(a)  This  class  contains  most  of  the  items  but  with  the  least 
total  dollar  demand.  (See  Table  on  pag«  43) 

(b)  Dependent  Model  satisfied  an  additional  6.5%  of  total 
requisitions  over  1794  for  the  same  fixed  cost. 

(c)  The  curves  on  this  graph  are  very  similar  to  those  from 

first  sample. 

(3)  Graph  3  (Strat  Class  2) 

(a)  This  class  has  higher  dollar  demand  activity. 

(b)  Dependent  Model  satisfied  an  additional  2.5%  requisitions 
over  1794  for  the  same  fixed  cost. 

(4)  Graphs  4  and  5  (Strat  Class  4  and  5) 

(a)  These  classes  represent  greater  requisition  activity  than 

the  previous. 

(b)  It  is  clear  that  there  is  no  advantage  to  using  the  Dependent 
Algorithm  for  these  classes  of  items . 

(c)  The  Dependent  Algorithm  converges  to  a  long  term  average  as 
the  requisition  activity  increases.  This  type  of  algorithm  has  not  worked 
well  in  previous  studies  with  the  active  items. 
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5.5  Coaments  on  the  Dependent  Model 

Using  a  heuristic  to  measure  performance,  the  Dependent  Model  shows  a 
Increase  in  requisitions  satisfied  over  the  current  forecast  method.  Additional 
comments  concerning  this  algorithm  are  as  follows: 

Implementation 

The  data  needed  for  implementation  for  the  Dependent  Model  are  as  follows: 

(1)  The  previous  two  year  history  is  used  to  determine  the  requisition 
class  of  the  series. 

(2)  A  catalog  based  on  empirical  estimates  is  used  to  determine  the 
expected  number  of  non-zero  quarters  in  the  next  PLT  period.  The  catalog  is 
a  function  of  requisition  class  and  PLT. 

(3)  The  average  demand  per  non-zero  quarter  is  computed  over  the  item's 
past  history. 

(4)  The  forecast  is  the  product  of  the  average  demand  per  non-zero 
quarter  times  the  expected  number  of  non-zero  quarters  for  the  next  PLT. 

Refinements 

There  are  several  refinements  that  could  be  made  to  the  model  but  weren't 
explored.  Some  of  these  are: 

(1)  Combine  catalog  estimates  with  the  item's  history. 

(2)  Use  exponential  smoothing  or  a  longer  base  period  to  determine  the 
requisition  class  of  the  series. 

(3)  Use  other  estimates  to  compute  the  expected  size  of  the  next  non-zero 
demand  quarter. 

Other  Considerations 

(1)  Sensitivity  to  the  catalog.  The  catalog  is  computed  using  estimates 
of  the  probability  of  seeing  a  non-zero  demand  quarter.  This  probability  is 
directly  related  to  the  requisition  class  of  the  item  and  may  not  be  a 
characteristic  of  the  type  of  population  sampled.  If  this  is  true,  then  the 
catalog  from  this  report  may  be  used  for  other  types  of  items.  This  conjecture 
has  yet  to  be  demonstrated. 

(2)  Additional  testing.  The  results  of  this  study  should  be  confirmed 
using  a  detailed  inventory  management  simulator.  Since  the  management  of 
inactive  items  is  a  topic  for  a  future  IRO  project,  this  simulation  was  deferred 
to  this  new  project. 
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CHAPTER  VI 


CONCLUSIONS 

6 . 1  Identification  of  Inactive  Items 

Descriptive  variables  such  as  the  IMPC  codes,  unit  price,  maintenance 
factors,  and  procurement  lead  time  did  not  show  any  direct  relationship  with 
the  requisition  activity  of  the  item.  These  variables  should  not  be  used  to 
identify  an  inactive  item. 

The  demands  per  requisition  increased  as  the  requisition  activity  increased. 
The  forecast  of  demand  should  consider  the  requisition  frequency  of  the  item. 

The  interarrival  times  between  non-zero  demands  appeared  to  be  relatively 
small  even  for  low  requisition  items.  This  could  be  due  to  a  clustering  of 
requisitions  and  should  be  considered  when  making  a  forecast. 

6.2  Characteristics  of  Demand 

There  were  some  indications  that  the  probability  of  a  non-zero  demand 
quarter  was  dependent  on  what  happened  in  the  previous  quarter.  A  dependent 
demand  model  should  be  considered  along  with  an  independent  model. 

6.3  Forecast  Algorithm  Evaluation 

The  decomposition  type  forecast  algorithm  performed  better  than  the 
models  currently  being  used  for  inactive  items.  The  Dependent  Algorithm 
performed  best  with  an  estimated  5.5%  increase  in  performance  for  the  low  demand 
items.  This  increase  in  performance  indicates  that  additional  work  with  the 
model  may  be  fruitful. 

6.4  Future  Work 

a.  Develop  new  management  policies  incorporating  the  results  from  this 
study.  Develop  a  simulator  to  test  these  policies. 

b.  Hake  refinements  as  mentioned  in  5.5  to  the  Dependent  Model  and  test 
in  simulator  from  above. 

c.  Determine  the  applicability  of  the  catalog  produced  in  this  study  for 
use  with  inactive  items  in  general. 
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APPENDIX 


STATISTICAL  ERROR  MEASURES  COMPARING  VARIOUS  FORECAST 
ALGORITHMS  WITH  ZERO  FORECAST  ON  A  CLASS  OF  LOW 
DEMAND  ITEMS  (ST1) 
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Forecast  Methods 


The  five  basic  forecast  algorithm  tested  were  of  the  form  of  a  weighted 
moving  average  (1794),  moving  median  (MED),  Kalman  filter  (KAL) ,  a  variable 
base  moving  average  utilizing  a  tracking  signal  (TRIG)  and  a  moving  average 
on  demand  (MOV-D) .  The  underlying  structure  of  these  algorithms  are  as  follows: 

(1794): 

This  is  the  current  Army  forecasting  procedure  which  is  a  weighted 
eight  quarter  moving  average  with  weights  proportioned  to  quarterly 
flying  hours. 

(MEDIAN) : 

This  is  the  median  of  the  last  four  quarters. 

(Kalman  Filter) : 

For  a  general  class  of  statistical  processes,  this  is  a  minimum 
mean  squared  error  algorithm  which  is  structurally  similar  to 
exponential  smoothing  where  the  smoothing  weights  are  variable 
and  updated. 

(TRIG  Tracking  Signal) : 

This  method  switches  between  a  weighted  four  and  eight  quarter 
moving  average  where  the  weights  are  parameters  determining  the 
amount  of  additional  weight  to  give  the  current  observations. 

(MOV-D) : 

This  is  an  eight  quarter  moving  average  on  demand. 
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